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ABSTRACT 


For the sixth Sea-Viewing Wide Field-of-View Sensor (SeaWiFS) Intercallibration Round-Robin Experiment (SIRREX-6), 
NASA personnel carried the same four Satlantic in-water radiometers to nine separate laboratories and calibrated them. 
Two of the sensors were seven-channel radiance heads and two were seven-channel irradiance heads. The calibration and 
data reduction procedures used at each site followed that laboratory’s normal procedures. The reference lamps normally 
used for the calibration of these types of instruments by the various laboratories were also used for this experiment. NASA 
personnel processed the data to produce calibration parameters from the various laboratories for comparison. 


These tests showed an overall agreement at better than the ± 2% level. Analysis of each laboratory’s efforts and specific 
data handling procedures are included. 
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1. INTRODUCTION 


2.1.1 Field of View of Radiance Heads 


This document details SIRREX-6. It describes the test 
equipment, calibration procedures, and data reduction 
procedures that were used. The Data Analysis section 
documents data collection at the participating laboratories 
and gives specific software procedures. 

The full names of the participating laboratories are given in 
table 1 and repeated in appendix A with addresses and 
points of contact. 

SIRREX-6 was performed in a completely different manner 
from SIRREX-1 through SIRREX-5. In those tests, labora- 
tory references were brought to a central location and tested 
against one another. In SIRREX-6, four commonly used 
field instrument were taken to each laboratory and tested 
using the laboratory’s standards and procedures. 

Conclusions drawn from this effort and suggestions for 
future SIRREX efforts are given at the end this document. 


2. SIRREX-6 TEST PROCEDURE 

For SIRREX-6, NASA personnel carried the same four 
Satlantic in-water radiometers to nine separate laboratories 
and calibrated them. The calibration procedures used 
followed the individual laboratory’s normal procedures and 
lamps for calibrations of these types of instruments. 
Variations from the standard procedures are covered in 
section 3.3 and section 3.4. 

2.1 Instruments 

The instruments used for the SIRREX-6 are shown in figure 
1 and listed in table 2. The choice of Satlantic radiance and 
irradiance sensor heads was based upon their availability 
and ubiquitous use within the ocean color community. 


The laboratories provided the plaque or integration sphere 
for the radiance tests. 

The plaque had to be large enough and the instrument close 
enough so that the field of view of the instrument lay on the 
plaque. The 99% field of view for the irradiance heads is an 
ellipse 450 mm (17.7 inches) by 300 mm (1 1.8 inches) 
when the head is set at 300 mm from the plaque at an angle 
of 45°. The instrument center line passes through one focus 
of the ellipse and is therefore off center. 

Some laboratories had plaques large enough (650 mm, 25.6 
inches) to cover this ellipse with the instrument center line 
on the center of the plaque. Most laboratories adjusted the 
setup to more closely center the ellipse on the plaque. 
Standard procedures used by the laboratory were employed 
where they existed. 


Table 2. Hardware Used for SIRREX-6 

2 — Satlantic OCR-200, in-water, 7 sensor, Radi 
ance, S/N 038 and S/N 039 ( a cylinder 3.5 
inches in diameter and 4.25 inches long) 

2 — Satlantic OCI-200, in-water, 7 sensor, Irradi 
ance, S/N 047 and S/N 049 
1 — Satlantic in water A/D unit, S/N 10 
1 — Laboratory Interface and Power Unit 
Cables: 

2 — Sensor Head to A/D, 2 meters 
1 — A/D to Deck Interface Unit, 5 meters 

1 — Deck Interface Unit to Lap Top, 1.5 meters 

2 — AC Power Cables, 1 .5 meters 

1 — Laptop computer with control and acquisition 

hardware loaded 

2 — Metric rule and a right angle 
3 — Carrying cases 


Table 1 . Participating Laboratories 


1 . 

Satlantic 

Satlantic Inc. 

August 11, 1997 

2. 

GSFC 

Goddard Space Flight Center 

August 20, 1997 

3. 

PML 

Plymouth Marine Laboratory 

September 8, 1997 

4. 

JRC-SAI 

Joint Research Center 

September 17, 1997 

5. 

CHORS 

Center for Hydro-Optics & Remote Sensing 

October 2, 1997 

6. 

Biosphere 

Biospherical Instruments 

October 3, 1997 

7. 

UCSB 

University of California at Santa Barbara 

October 4, 1997 

8 . 

NRL 

Naval Research Laboratory 

November 6, 1997 

9. 

GSFC 

Goddard Space Flight Center 

November 21, 1997 

10. 

DLR 

Institut fiir Weltraumsensorik 

September 12, 1997 

11. 

WFF 

Wallops Flight Facility 

December 2, 1997 

12. 

GSFC 

Goddard Space Flight Center 

February 19, 1998 
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SIRREX-6 Test Equipment 


Figure 1 

S/N 049 

OCI-200 Head _± 

_____ C 

/Cable #2 4 . 250-^1 uj 

2 meters s/N 038 | 
OCR-200 Headj — n ” 

Cable #1 
2 meters 


S/N 047 14l 


S/N 039 


Cover 


Cover 


Cable #3 


Tape 

n 

Scale 


Right Angle 


4 meters 


A/D Unit 


ocp-100 

S/N 010 



Cable #4 
RS-232 


Power Supply btox 



Laptop Computer 


Cable #5 
Power 


110 VAC or 220 VAC 


A second data set was also taken with the head rotated 180 
degrees around the optical axis. The field of view of the 
channel closest to the lamp is most likely to extend off the 
plaque, while the channel farthest from the lamp is nearly 
always completely on the plaque. The center channel, the 
two top channels, and the two bottom channels should show 
little change with the 180° rotation. A significant difference 
between the near and far channels would have been inter- 
preted as evidence that part of the field of view was off the 
plaque. No significant variation of this type was found. 

For the case where laboratories used integrating spheres for 
the calibration of the radiance sensors, the position of the 
radiance head relative to the sphere was critical. The radiance 
heads needed to be positioned such that the field of view of 
the head saw only the aperture of the sphere. If the head was 
placed too far from the sphere aperture, the field of view of 
the head would include a portion of the external face of the 
sphere and radiance values would be abnormally low. 


In the opposite situation, if the head was positioned too 
close to the sphere aperture, the quartz face of the radiance 
head reflected a significant amount of light back into the 
sphere. The total reflectance from both sides of the quartz 
window and the surrounding black aluminum can amount to 
3% of the light falling on the face. If this light reenters the 
sphere it is reintegrated and increases the observed radiance 
values. At greater distances the head face fills a smaller 
portion of the sphere’s illuminated field, and less light is 
reflected back at the smaller angles. For most spheres 
examined in this study, the sphere-to-radiance head distance 
fell between 200 mm and 500 mm. 

2.1.2 Spectral Characteristic of Heads 

The Center Wavelength (CWL) for each of the seven filters on 
each instrument is given in table 3 through table 6 below. 
Three different values are given. The wavelength calculation 
approach normally used at a laboratory was applied. 
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Table 3. Spectral Dependence of Head S/N 049 


CWL" 

CWL b 

Centroid* 

Radiance d 

20 Degree Cone 


Full Scale 

OCI-200 

S/N 049 



411.0 

411.90 

411.60 

N/A 

442.8 

443.78 

445.25 

N/A 

490.4 

491.40 

490.85 

N/A 

509.3 

510.38 

510.70 

N/A 

554.6 

555.65 

554.10 

N/A 

665.5 

665.72 

665.25 

N/A 

682.7 

684.02 

683.55 

N/A 


Notes: 

(a) The spectral dependence tests for these filters were 
run with a very narrow field-of-view instrument. This 
Center Wavelength with 20 Degree Cone value included 
a slight blue shift attributed to rays entering the instru- 
ment from wider angles. The units are nm. 

(b) This Center Wavelength (CWL) was calculated with 
Full Width Half Maximum (FWHM). The units are nm. 

(c) This Centroid is the center wavelength calculated 
from the entire area under the curve. The units are nm. 

(d) The Radiance Full Scale value in air is used to set the 
maximum output for radiance tests with integration 
spheres. Units are uW/cm A 2/nm/Sr. 


Table 5. Spectral Dependence of Head S/N 047 


CWL" 

CWL b 

Centroid* 

Radiance d 

20 Degree Cone 


Full Scale 

OCI-200 S/N 047 



411.0 

411.92 

411.55 

N/A 

442.5 

443.50 

442.35 

N/A 

489.9 

490.90 

490.90 

N/A 

509.4 

510.48 

511.10 

N/A 

554.6 

555.72 

552.60 

N/A 

665.8 

666.95 

665.40 

N/A 

682.8 

684.10 

684.60 

N/A 


Table 6. Spectral Dependence of Head S/N 039 


CWL* 

CWL b 

Centroid* 

Radiance* 1 

20 Degree Cone 


Full Scale 

OCR-200 S/N 039 



411.5 

412.38 

411.8 

2.74 

442.9 

443.85 

443.70 

2.65 

489.7 

490.70 

490.55 

2.71 

509.6 

510.68 

510.85 

2.89 

554.2 

555.33 

552.30 

2.92 

665.7 

666.90 

665.43 

1.27 

682.9 

684.22 

684.80 

1.15 


Table 4. Spectral Dependence of Head S/N 038 


CWL* 

CWL b Centroid* 

Radiance* 1 

20 Degree Cone 

Full Scale 

OCR-200 S/N 038 


411.3 

411.90 411.60 

2.78 

443.0 

433.78 445.25 

2.82 

489.0 

491.40 490.85 

2.81 

509.7 

510.38 510.70 

2.87 

554.1 

555.65 554.10 

2.90 

665.9 

666.72 665.25 

1.24 

682.8 

684.02 683.55 

1.11 


2.1.3 Equipment Furnished by Laboratory 

The laboratory supplied: 

1 . Mounting for Head — This was either a pair of rings with 
three adjustment screws that can handle a 3.5 inch (90 mm) 
cylinder, 4.25 inches (115 mm) long centered in the light 
path, “V” blocks, or a vise. An adjustable stage was also 
commonly used to control the height of the head. 

2. Alignment Equipment — The equipment normally 
employed by the laboratory to align sensors. This generally 
included a laser, a lamp replacement cross hair, and front 
surface mirrors. 

The heads were aligned with its central axis on the optical 
axis. Some laboratories also offset the head and aligned 
each input aperture in turn. This procedure had very little 
effect on the calculated values. 

3. Lamp — The reference lamp that was normally used by 
the laboratory. The laboratory provided a valid calibration 
report for the lamp used. Some laboratories did the interpo- 
lation calculations to the specific sensor wavelengths 
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themselves. For the others the four point Lagrange method 
developed by NIST was used (see section 3.4). 

4. Diffuser Plaque — The diffuser plaque normally used by 
the laboratory. The laboratory provided a valid calibration 
report for the plaque. The four point NIST procedure was 
used for interpolation. 

5. Integration Sphere — Some laboratories used an integra- 
tion sphere and provided valid calibration reports for them. 

2.1.4 Additional Tests 

Some laboratories calibrated each of the seven optical 
apertures separately, with each moved to the optical axis. 
Where this was the practice, the center channel was taken, 
then the head was offset, and each of the six other channels 
was read. The on-axis reading for each channel was used for 
the data reduction. 

Some laboratories use a black lollipop to shadow the head 
for an ambient reading. Where this was standard practice, 
both a cover and ambient reading were taken. 

Some laboratories requested additional tests with a second 
lamp. 

2.2 Nominal Test Procedure 

The laboratory was requested to run through its normal 
calibration procedure for the irradiance and radiance sensors 
using their light sources and diffuser plaques or integration 
spheres. If the laboratory did not normally test these heads, 
their procedures for similar instruments were used. 

2.2.1 Nominal Test Procedure 

The SIRREX-6 tests followed the normal laboratory 
procedures for in-water radiometers as closely as possible. 
Generally the test included the following steps: 

Radiance Test: 

1 . Align lamp and plaque 

2. Mount first radiance head 

3. Develop procedure for exchange of he ads 

4. Warm up the lamp (10 to 20 minutes) 

5. Record 16 seconds of data with head covered 

6. Record 16 seconds of data with head uncovered 

7. Record additional data if needed 

8. Mount second radiance head, in the same position as 
the first 

9. Record 16 seconds of data with head covered 

10. Record 16 seconds of data with head uncovered 

1 1 . Record additional data if desired 

12. Cool lamp 

13. Repeat with second lamp if necessary 


Irradiance Test: 

1 . Align irradiance head 

2. Develop head replacement procedure 

3. Check 50 centimeter distance with cross-hair front 
surface 

4. Warm up the lamp (10 to 20 minutes) 

5. Record 16 seconds of data with head covered 

6. Record 16 seconds of data with head uncovered 

7. Record additional data if desired 

8. Mount second irradiance head in the same position 

9. Record 16 seconds of data with head covered 

10. Record 16 seconds of data with head uncovered 

1 1 . Record additional data if desired 

12. Turn off lamp and log lamp on-time 

3. SIRREX-6 DATA REDUCTION 

The SIRREX-6 test data were reduced with the following 
steps: 

1. Collect data 

2. Convert to ASCII 

3. Add mean and standard deviation 

4. Interpolate lamp, plaque, and sphere for exact 
wave lengths 

5. Summarize for each test 

6. Summarize for each head 

7. Make overall comparisons 

8. Review special tests 

3.1 Take Data 

The data were collected using the software program 
PROVTEW.EXE provided by Satlantic. A binary file was 
stored for each test with the file name extension “.RAW” 
and the test description was entered in the lab notebook. 

This software read the instantaneous light intensity of each 
channel with a separate silicon photodiode about every 100 
msec. A slow count of twenty was allowed for each test. 
Given the instrument’s sampling frequency this produced 
more than 150 sets of readings per test file. 

3.2 Convert to ASCII 

The files were converted to ASCII using the program 
ASCnCON.EXE provided by Satlantic. This was done with a 
batch file and took about 20 minutes for a day’s testing. The 
files were saved with the extension “.DAT” . Table 7 is an 
example of this file type. The units are in counts with zero at 
32768 counts. 
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Table 7. Abbreviated Sample ASCII Data 

SN(OOIO) ED(41 1.0) LU(41 1. 3) LU(443.0) LU(489.0) LU(509.7) LU(554.1) LU(665.9) LU(682.8) 


10 

32779 .. 

. 32779 

32778 

32779 

32769 

32777 

32780 

32773 

10 

32779 .. 

. 32779 

32778 

32780 

32769 

32778 

32780 

32773 


10 

32778 .. 

. 32778 

32777 

32779 

32770 

32777 

32779 

32774 

10 

32778 .. 

. 32779 

32778 

32780 

32769 

32778 

32779 

32774 

10 

32777.. 

. 32776 

32780 

32780 

32769 

32778 

32778 

32775 

10 

32777 .. 

. 32777 

32779 

32779 

32771 

32778 

32779 

32774 


3.3 Add Mean and Standard Deviation 

The ASCII files were read into MS-Excel as tabulation 
delimited tables. The data from the active head was identi- 
fied. A summary box was added below the data listing giving 
the wavelength heading, the average data counts, and the 
standard deviation of the counts. The average was labeled 
with the file name. The file was then saved with an “.XLS” 
extension. This process took about 5 minutes per data file. 
Table 8 is an example of this file type. 


Most laboratories used the four point Lagrange method 
developed by NIST. The reference lamp supplier, Optronic 
Laboratories, Inc., recommends this method and provides 
the equation in the “Report of Calibration” for their FEL 
lamps. 

This procedure uses the four points spanning the desired 
wavelength and is shown in equation 1. Applying this 
equation to the GSFC F-474 lamp data shown in figure 2 
yields figure 3 and figure 4. A graphic equivalent of this 
equation draws a line between the two central points and 


Table 8. Mean Addition to Sample ASCII Data 

LU(41 1.3) LU(443.0) LU(489.0) LU(509.7) LU(554.1) LU(665.9) LU(682.8) 

Mean 32777.62 32778.78 32779.06 32769.59 32777.36 32779.40 32774.049 AT0811A.XLS 
STD 1.002 0.818 0.704 0.863 0.683 0.692 0.762 


3.4 Interpolation of Calibration Constants 

The calibration constants available for the lamps, plaques, 
and integration spheres were not taken at the exact wave- 
lengths of the heads. The available calibration data were 
entered into an Excel spreadsheet that calculates the 
interpolated values. Some laboratories provided this 
information using their standard software. This step took 
about 30 minutes. 


then warps the line with the two outside points. Figure 3 
shows the interpolated values from 400 nm to 450 nm and is 
slightly concave. Figure 4 shows the interpolated values 
from 654.6 nm to 700 nm and is very slightly convex. 

Plymouth Marine Laboratory (PML) used a procedure of 
fitting an equation by linear regression to the calibration 
data. This procedure was also developed by NIST. Equation 
2 shows this form. The fit was done in two stages. First the 


NIST Lagrange interpolation formula 


D(X)=1 


k = 


4 

n,(* -*.)/(** 


E(X) 


( 1 ) 


where x = the wavelength to be interpolated 

x is xk = 4 consecutive wavelengths whose values are already given in the datafile 
such that X] < X 2 < x < X3 < X4. 

E(X) = spectral data value for wavelength x k 
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Figure 4 


logarithmic component was fitted to the data by linear 
regression, producing coefficients A 0 and A,. Then a qua- 
dratic equation was added with a second fitting, while 
holding A 0 and constant. This produced coefficients B 0 
through B 4 . The complete equation was then used to calculate 
the irradiance at specific wavelengths. 

Figure 2 shows that the slope of the curve is well behaved 
through the range of interest (410 nm to 682 nm). At the 
short wavelength end (410 nm) the signal is much lower than 
at the long wavelength end (682 nm). This means that small 
errors in the interpolation at the short wavelengths result in a 
much larger error as a percentage of the signal. 


3.5 Test Summary Sheet 

The test data averages are copied to a spread sheet with all 
the data for one test on a specific head. This includes (at 
least) an illuminated test and a dark test with the head 
covered. It may additionally include an ambient test with the 
view blocked but not completely covered, and seven off-set 
tests with each of the head’s seven optical ports moved to the 
optical axis. 

This spreadsheet calculates the calibration constants for the 
head and it used calibration information about the lamp and 
plaque, or sphere. 

This process took about 20 minutes per test. 


Linear regression lamp interpolation fit: 

E (A)= (z? 0 + 5, A + B 2 ?i + 5 3 A 3 + 5 4 A 4 )* (exp(4, + A J A))* A -5 (2) 


where A 0 } Ai = primary fit coefficients for greybody equation 

Bo,. . .B 4 = secondary fit coefficients for quadratic equation 
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Table 9. Single Test Spread Sheet Example 


Satlantic File; S1I047A.XLS 

1 1 - Aug-97 Used: S AT08 1 1 G.TXT S AT08 1 1 H.TXT 

00-200 S/N 047, Pair 2 First data set 


ED(41 1.0) ED (442. 8) ED(490.4) ED(509.3) ED(554.6) ED(665.5) ED(682.7) 


Dark 

Stdev 

32777.2 

0.642 

32779.1 

0.557 

32774.6 

0.644 

32775.4 

0.515 

32777.7 

0.787 

32776.8 

0.581 

32779.2 

0.565 

SAT0811H.XLS 

Light 

Stdev 

33147.9 

0.456 

33345.9 

0.659 

33790.7 

0.718 

33881.5 

0.614 

34286.4 

0.775 

36799.0 

1.164 

36798.0 

1.558 

SAT0811G.XLS 

F459 

2.361 

3.711 

6.268 

7.373 

10.170 

16.660 

17.510 

uW/cm 2 nm 


Distance mm 500 

Leal 2.361E+00 3.711E+00 6.268E+00 7.373E+00 1.017E+01 1.666E+01 1.751E+01 uW/cm 2 nm 

Cal 6.370E-03 6.547E-03 6.168E-03 6.665E-03 6.740E-03 4.142E-03 4.357E-03 uW/cm 2 nm/count 

Coefficient 

LabVal 6.377E-03 6.524E-03 6.141E-03 6.676E-03 6.741E-03 4.147E-03 4.362E-03 uW/cm 2 nm/count 
% Dif 0.11 -0.35 -0.44 0.15 0.01 0.14 0.14 % 


3.6 Summary for Each Head 

The results for each laboratory were then entered in the 
SIRREX.XLS file by optical head. The calibration para- 
meters were compared as a percentage of the mean for all 
laboratories. This sheet is reviewed in detail in section 4. 

3.7 Overall Comparisons 

Overall comparisons were then worked up in the lead 
Summary Sheet in SIRREX.XLS. 

3.8 Special Tests 

Special test data were also reduced in SIRREX.XLS. 

4. SIRREX-6 TEST RESULTS 

The following tables and figures were derived from the 
SIRREX-6 data. 


4.1.1 Deviation From Mean 

Figure 5 gives the highest level overview. It shows the 
percentage deviation from the mean of the calibration 
coefficients averaged over all instrument wavelengths for all 
four instrument heads. 

This figure shows an overall consistency within 1%. The 
Max and Min bars do show that there are a few outliers in 
the data. This is a very positive overall result and demon- 
strates excellent compliance with the goals of the program. 

The most significant outliers were investigated and found to 
be the result of questionable calibration numbers. In one 
case the reference lamp used to obtain the calibration 
number failed after only a few more hours of use. In 
another, the calibration number was thought to be suspect 
but was the best available on the day of the test. Both these 
references were retested before they were used for other 
published results. 


4.1 Overviews of Results 

This overview starts at the most reduced data and works 
back toward the basic data. 
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Figure 5. Percent Difference from Mean for All Wavelengths and All Heads 


Table 10, table 11, and figure 6 show the same information 
but separated for the radiance and the irradiance tests. The 
radiance tests include laboratories that use plaques and 
those that use integration spheres. Any trends, such as those 
caused by instrument drift, are small compared to the 
variation between laboratory sources. 


Table 13 and table 14 show the same information expanded 
by wavelength. Two outliers show in the LU(410.x) column 
for the radiance heads. Integration spheres designed for 
calibration of space instruments saturate the radiance heads 
at long wavelengths. The radiance tests show less variation. 


Table 10. Percent Difference From Mean for All Wavelengths, Two Radiance Heads 


Radiance 

Mean 

Max 

Min 

STD 


1 Satlantic 

-0.67 

0.10 

-1.55 

0.48 

% 

2 GSFC 1 

0.19 

1.29 

-1.10 

1.02 

% 

3 PML 

1.85 

5.02 

-0.39 

1.55 

% 

4 JRC-SAI 

0.32 

2.14 

-1.76 

1.19 

% 

5 CHORS 

-1.19 

0.86 

-8.05 

2.93 

% 

6 Biosphere 

-1.10 

-0.25 

-2.04 

0.52 

% 

7 UCSB 

0.35 

2.31 

-0.63 

0.99 

% 

8 NRL 

-0.28 

1.28 

-2.56 

1.29 

% 

9 GSFC 2 

0.36 

2.52 

-0.59 

1.26 

% 
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Table 11. Percent Difference From Mean for all Wavelengths, Two Irradiance Heads 

Irradiance 



Mean 

Max 

Min 

STD 


1 Satlantic 

-0.26 

0.44 

-0.76 

0.38 

% 

2 GSFC 1 

0.76 

1.76 

-1.56 

0.86 

% 

3 PML 

-0.74 

0.86 

-1.65 

0.89 

% 

4 JRC-SAI 

0.20 

1.55 

-1.57 

1.03 

% 

5 CHORS 

0.87 

2.29 

-1.14 

1.00 

% 

6 Biosphere 

-0.55 

1.53 

-1.80 

0.84 

% 

7 UCSB 

1.31 

2.28 

-1.59 

1.20 

% 

8 NRL 

-1.13 

1.46 

-2.51 

1.13 

% 

9 GSFC 2 

-1.03 

1.61 

-1.99 

1.08 

% 

10 GSFC 3 

0.07 

0.62 

-0.25 

0.25 

% 



Laboratories 


■ Radiance 
Irradiance 


Figure 6. Percent Difference From Mean, Radiance and Irradiance 


Table 12. Percent Difference From Mean by Wavelengths. Two Radianc e Hea ds 


1 Satlantic 

2 GSFC 1 

3 PML 

4 JRC-SAI 

5 CHORS 

6 Biosphere 

7 UCSB 

8 NRL 

9 GSFC 2 


LU(41 1 .x) LU(443.x) LU(489.x) LU(509.x) LU(554.x) Lll(665.x) LU(682.x) 


-0.58 

-0.69 

-0.72 

-1.46 

-0.82 

0.05 

-0.45 % 

1.04 

-1.02 

-0.91 

0.72 

1.11 

Sat 

Sat % 

4.88 

-0.28 

1.97 

1.26 

1.94 

0.89 

2.28 % 

1.69 

1.94 

0.36 

0.27 

-1.54 

0.15 

-0.60 % 

-7.92 

-0.19 

0.13 

0.10 

-0.35 

0.09 

0.76 % 

-0.53 

-1.33 

-1.66 

-1.64 

-1.18 

-0.51 

-0.85 % 

2.11 

1.40 

0.21 

-0.03 

-0.45 

-0.46] 

-0.35 % 

-2.21 

-0.06 

0.75 

0.41 

Sat 

Sat 

Sat % 

-0.31 

-0.52 

0.33 

1.94 

2.43 

Sat 

Sat % 


Sat — Reading Saturated 
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Table 13. Percent Difference From Mean by Wavelengths, Two Irradiance Heads 


1 Satlantic 

2 GSFC 1 

3 PML 

4 JRC-SAI 

5 CHORS 

6 Biosphere 

7 UCSB 

8 NRL 

9 GSFC 2 


ED(41 1 .x) ED(442.x) ED(490.x) EP(509.x) ED(554.x) ED(665.x) ED(682.x) 


-0.67 

-0.34 

0.04 

-0.49 

-0.45 

0.16 

-0.08 % 

0.79 

0.72 

1.18 

1.18 

1.05 

0.27 

0.10 % 

0.22 

-1.00 

-1.59 

-1.50 

-1.27 

-0.14 

0.08 % 

1.05 

1.53 

0.45 

0.10 

-1.46 

-0.10 

-0.17 % 

0.83 

0.24 

0.72 

2.10 

1.73 

0.05 

0.40 % 

-1.09 

-1.15 

-0.84 

-0.69 

-0.70 

0.42 

0.22 % 

1.85 

2.11 

1.81 

1.73 

1.88 

-0.14 

-0.10 % 

-2.19 

-1.51 

-1.26 

-1.14 

-1.29 

-0.31 

-0.24 % 

-1.87 

-1.80 

-1.42 

-1.20 

-0.90 

-0.07 

0.03 % 


4.1.2 Comparison With Protocols 

The desired test levels are set out in “Volume 25, Ocean 
Optics Protocols for SeaWiFS Validation, Revision 1," pp 
15, table 4, “Required instrument sensitivities for 
SeaWiFS validation and algorithm development as a 
function of radiometric measured variable and wave- 
length.” This table gives the following desired parameters 
at 412, 489, and 665 nm: 

E/0) — Saturation Irradiance in uW/cm 2 /nm 

d v 7 max 

L u (0) max — Saturation Radiance (Case-2/coccoliths) in 
uW/cm 2 /nm/sr 
E , — Calibration Irradiance 

Cal 

L . — Calibration Radiance 

cal 

These are the ideal levels for calibration of in-water 
instruments. Significant departures from these levels 
indicate that the instrument is not in the same operating 
range for the calibration and the test. 

Table 14 compares the results found in SIRREX-6 for the 
radiance tests with these protocol levels. It separates the 
radiance tests done with plaques from those done with 
integration spheres. 


The L(0)_ levels for the plaque tests are very low. There is only 
1 1% of the desired value. This is only a small signal of a few 
hundred counts (742 out of a possible 32,767). This low signal 
level leaves the test open to problems both of signal-to-noise ratio 
and A-to-D converter step size. The test is then sensitive to the use 
of lollipop for ambient counts and the room darkness. 

The L u (0) max levels for the integration spheres are much 
higher but this can lead to saturation at longer wavelengths. 
The highest level that did not produce saturation at a 
specific wavelength was selected for inclusion in the 
reduced data in SIRREX-6. 

To cover the entire SeaWiFS bandwidth an integration 
sphere must be able to adjust its light level over a wide 
range. The spheres designed for testing space instruments, 
such as the one at GSFC, are so bright that even at their 
lowest levels they still saturate the in-water instruments at 
the two longest wavelengths. 

Other integration spheres have their lamps mounted in 
separate cambers that can be isolated from the main sphere 
with mechanical stops to reduce the light that enters the 
sphere. This arrangement produced the needed adjustment 
range but complicated the sphere design and means that 
each stop requires a separate calibration. 
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Table 14. Radiance Percent Protocol Levels at Three Wavelengths, by Laboratory 


Radiance: Plaques 411.x nm 


Satlantic 

JRC-SAI 

Biosphere 

UCSB 


Protocol 
Mean Flux 


Mean % Protocol 
Max 


%Lcal %Lumax 

17.621 11.60 

12.65 11.86 

3.89 1 1 .60 

8.36 11.91 


10.63 

17.62' 


489.x nm 

%Lcal %Lumax 
18601 11-57 

15.09 11.69 

3.97 11.46 

8.50 11.67 


665.x nm 

%Lcal %Lumax 

16.881 15.74 

16.57 15.75 

3.45 15.65 

7.42 15.65 


0.60 

24.00 

1.50 

24.00 

4.50 

8.00 uW/cm A 2/nm 

0.06 

2.82 

0.17 

2.78 

0.50 

1.26 uW/cm A 2/nm 


15.70 

15.75 


Min 

Counts 

%/Count 

Radiance: Spheres 

GSFC 1 

PML 

CHORS 

NRL 

GSFC 2 


3.89 

11.60 

3.97 

11.46 

742 


2037 


0.01 


0.01 



287.75 

11.79 

177.77 

11.551 


33.67 

14.14 


3.45 15.65 % 

13010 Counts out of 32,767 
0.00 % 


45.48 

7.6.1 

22.09 

140.26 


25.58 Saturated 

15.87 % 

15.74 % 


Protocol 

Mean Flux 

Mean % Protocol 
Max 
Min 

Counts 

%/Count 


1.211 2.781 1.611 


201.351 11.571 107.501 


14.141 10.751 21.11 


15.74 % 
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Table 15. Irradiance Percent Protocol Levels, at Three Wavelengths, by Laboratory 


Irradiance: 

411.x nm 489.x nm 665.x nm 

%Ecal %Eumax %Ecal %Eumax %Ecal %Eumax 


Satlantic 
GSFC 1 
PML 
SAI 

CHORS 
Biosphere 
UCSB 
NRL 
GSFC 2 

115.11 

67.85 

122.41 

65.89 

108.92 

47.32 % 


139.80 

68.76 

140.93 

66.57 

118.53 

47.89 % 

114.88 

67.79 

119.35 

64.41 

106.71 

46.69 % 

47.52 

68.91 

57.43 

66.03 

62.51 

47.52 % 

136.55 

69.24 

137.60 

66.11 

116.94 

47.63 % 

134.55 

67.49 

139.02 

65.17 

119.70 

46.94 % 

140.57 

70.65 

134.61 

69.00 

113.51 

47.23 % 

114.32 

66.74 

120.70 

64.91 

107.39 

46.67 % 

127.15 

68.70 

130.96 

66.02 

113.54 

44.73 % 







Protocol 

Mean Flux 

2.00 

300.00 

5.00 

300.00 

15.00 

300.00 uW/cm A 2/nm/sr 


2.38 

205.38 

6.13 

198.04 

16.13 

140.87 uW/cm A 2/nm/sr 





Mean % 

Max 

Min 

Counts 

%/Count 

118.94 

68.46 

122.56 

66.01 

107.53 



140.57 

70.65 

140.93 



MU W 

47.52 

66.74 

57.43 

64.41 

62.51 

44.73 % 

380 


■HUE 


3752 


0.31 


0.12 


0.03 

% 





Table 15 gives the percentage of the protocol levels for the 
irradiance heads. Here the levels match the protocols very 
well, but the number of counts in the short wavelength 
channels is very low. A few stray counts thus have a 
significant effect on the data. 

4.2 Coefficients 

The primary data set for SIRREX-6 was the measured 
calibration coefficient for each of the four heads as taken 
at each laboratory. These are the numbers that are used to 
convert raw counts taken in the field into radiances or 
irradiances. 

4.2.1 Radiance Heads 

Table 16 and table 17 give the measured calibration 
coefficients for the two radiance heads S/N 038 and 


S/N 039. The units are (uW/cm 2 /nm/sr)/count. The 
wavelengths vary between the two units slightly, so the 
actual value measured by the filter manufacturer for the 
individual filters was used. The readings taken with an 
integration sphere versus plaque were marked. 

Where two capital letters appear in the “Test” column, two 
data sets were taken very close together in time and the 
results averaged. The difference between such tests was 
very small in all cases. 

At two laboratories, two separate reference lamps were 
used. The results shown as “% Dif., 2 Lamps” show 
excellent repeatability between separate lamps for tests run 
on the same day. 


SIRREX-6 


13 























Table 16. Head OCR-200 S/N 038, Calibration Coefficients by Wavelength 


LU(411.3) LU(443.0) LU(489.0) LU(509.7) LU(554.1) LU(665.9) LU(682.8) 


Date Lab Test 


8/11/97 Satlantic 



8.544E-05 

8.648E-05 

8.556E-05 

8.646E-05 

-0.13 

0.02 



A,B 8.701 E-05 8.595E-05 8.582E-0 


8.657E-05 


9/17/97 JRC-SAI A.B 8.745E-05 8.877E-05 
Plaque 


A,B 7.899E-05 8.683E-05 


8. 522 E-05 8.573E-05 8.497E-0 


A,B 8.749E-05 
C.D 8.760E-05 
-0.13 





NRL 1 A.B 

Sphere 


A.B 




8.689E-05 8.779E-05 8.914E-05 
8.640E-05 8.693E-05 9.059E-05 


Table 17. Head OCR-200 S/N 039, Calibration Coefficients by Wavelength 


LU(41 1 .5) LU(442.9) LU(489.7) LU(509.6) LU(554.2) LU(665.7) LU(682.9) 


Date Lab 
I 8/1 1/97 1 Satlantic 


8/12/97 


% Dif, 2 Lamps 


8/29/97 


A I 8.436E-051 8.11 IE-051 8.341 E-05 8.848E-05I 8.961 E-05| 3.882E-0e 


3.886E-0 


-0.481 -0.0 


8.450E-05 

8.1 14E-05 

-0.17 

-0.03 





10/4/97 CHORS 

Sphere 


10/3/97 


A.B 8.569E-05 8.107E-05 


8.170E-05 


8.326E-05 


|A,B| 7.838E-05 8.160E-05 



3.527E-05 


3.504E-0 


0.6 


9.070E-05 


9.103E-05 



6.246E-0 


3.91 9E-0 






10/6/97 UCSB 1 


10/6/97 \ Plaque 


% Dif, 2 lamps 


11/6/97 NRL 1 

Sphere 


11/21/97 GSFC 2 

Sphere 


8.479E-05 

8.076E-05 

8.298E-05 

8.798E-05 

8.966E-05 

8.728E-05 


9.023E-05 

9.088E-05 

8.667E-05 

8.294E-05 

8.437E-05 

8.942E-05 

9.015E-05 

0.70 

0.51 

0.03 

0.89 

0.80 


8.977E-05 8.921 E-05 3.876E-0 


3.886E-05 3.566E-0 


3.500E-0 


IBS 

iso 


A.B 8.283E-05 8.176E-05 8.429E-05 9.043E-05 


A.B 8.469E-05 8.146E-05 8.442E-05 9.171E-05 



3.536E-0 


3.530E-0 


0.1 







































































































































Table 18 and table 19 give the same information as the 
two tables above, but give it as a percentage of the 
difference from the mean for all laboratories. This percent- 
age was calculated by subtracting the value from the mean 
and dividing by the mean. 

Note that two entries have the two long wavelengths 
completely saturated and a third has the three long 
wavelengths saturated. These were all taken with integra- 
tion spheres originally designed for space instruments. 


The four outliers in the LU(41 1.x) columns are the result 
of using calibration numbers that were thought to be 
questionable, but were the best available on the day of the 
test. All the outliers occurred in the shortest wavelength 
where the signal is weakest. Experienced personnel have 
no difficulty recognizing questionable readings, but may 
not have the time and resources available to repeat the 
tests necessary to address the problem. 


Table 18. Head QCR-200 S/N 038, Percent Difference From the Mean by Laboratory and Wavelength 



LU(411.3) LU(443.0) LU(489.0) LU(509.7) LU(554.1) LU(665.9) LU(682.8) 

Mean 

8.591 E-05J 8.691 E-05| 8.668E-05J 8.902E-05| 8.998E-05) 3.798E-05) 3.390E-05 



Satlantic % 

-0.47 

-0.50 

-0.48 

-1.38 

-0.57 

0.1C 

■HKEil 


1.28 

-1.10 

-0.99 

0.45 

0.93 

64.52 

993.92 

PML ( 5 ) % 

5.02 

-0.39 

1.53 

1.16 

1.85 

0.87 

2.77 

IPkttgLM f— 

1.79 

2.14 

0.45 

0.58 

-1.32 

0.5C 

-0.81 

vasaimmmmm 

-8.05 

-0.08 

0.18 

0.06 

-0.38 

0.12 

0.66 

Biosphere % 

-0.80 

-1.35 

-1.97 

-1.24 

-1.10 

-0.46 

-0.6E 

UCSB ( 3 ) % 

1.91 

1.20 

0.09 

-0.08 

l 

o 

cn 

CD 

-0.62 

-0.63 

pamgra 

-1.87 

-0.03 

1.28 

0.13 

WKMffiH 

407.29 

503.61 


-0.24 

-0.59 

0.29 

1.77 

HE 

64.52 

543.67 

( 2 ) Non-Lambertian correction used 

( 3 ) Central wavelengths used 

( 4 ) Two longest wavelength channels are saturated 

( 5 ) Integration sphere used 

( 6 ) Three longest wavelength channels are saturated 


Table 19. Head OCR-200 S/N 039, Percent Difference From the Mean by Laboratory and Wavelength 



Mean 


Satlantic 

GSFC 1 

rows 

PML 

m 

JRC-SAI 

tbwm 

CHORS 


Biosphere 

UCSB 

mm 

NRL 

RH 


1 Z9i 



LU(411.5) 

LU(442.9) 

LU(489.7) 

LU(509.6) 

LU(554.2) 

LU(665.7) 

LU(682.9) 


8.501 E-05| 8.184E-05 

8.41 1E-05| 8.981 E-05 

9.080E-05 

3.884E-05 3.535E-05 









% 

-0.68 

-0.87 

-0.97 

-1.55 

-1.07 

0.00 

-0.56 


%\ 

0.80 

-0.94 

-0.82 

0.99 

1.29 


85.44 


% 

4.75 

-0.17 

2.41 

1.35 

2.02 

0.90 

1.79 


% 

1.59 

1.74 

0.28 

-0.04 

-1.76 

-0.21 

-0.40 


% 

-7.79 

-0.29 

0.09 

0.15 

■HHiCE! 

0.05 

0.86 


% 

-0.25 

-1.32 

-1.35 

-2.04 

-1.26 

-0.56 

-1.02 


% 

2.31 

1.61 

0.32 

wms® 


-0.30 

-0.07 


% 

-2.56 

-0.09 

0.21 

0.69 

16.61 

396.09 

478.70 


% 

-0.37 

-0.45 

0.36 

2.11 

2.52 

60.81 

85.45 



( 2 ) Non-Lambertian correction used 

( 3 ) Central wavelengths used 

( 4 ) Two longest wavelength channels are saturated 

( 5 ) Integration sphere used 

( 6 ) Three longest wavelength channels are saturated 
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4,2.2 Irradiance Heads 


lengths vary between the two units slightly as the actual 
value measured for the individual filters is used. 


Table 20 and table 21 give the measured calibration 
coefficients for the two irradiance heads S/N 038 and 
S/N 039. The units are (uW/cm 2 /nm)/count. The wave- 


Table 20. Head QCR-200 S/N 049, Calibration Coefficients by Wavelength 


ED(411.0) ED(442.8) ED(490.4) ED(509.3) ED(554.6) ED(665.5) ED(682.7) 

Date Lab Test 

1 8/11/97 

Satlantic 

m 

6.070E-03 

6.232E-03 

5.929E-03 

6. 808 E-03 

6.890E-03 

4.534E-03 

4.403E-03 

\wmm 


B 

6.045E-03 

6.203E-03 

5.869E-03 

6.736E-03 

6.846E-03 

4.515E-03 

4.351 E-03 

imnaa 


0.41 

0.47 

1.01 

1.06 

0.64 

0.42 

1.18 


^/29/97 GSFCl |A,B 6.138E-03| 6.300E-03 5.987E-03| 6.882E-03 6.991 E-03 4.576E-03| 4.481 E-03| 


9/8/97 PML [A 6.126E-03| 6.198E-03 5.810E-03| 6.700E-03| 6.814E-03 4.478E-03| 4.372E-03 


9/1 7/97 IJRC-SAI |C 6.166E-03t6.338E-03 5.925E-03I 6.807E-03I 6.785E-03I 4.539E-03I 4.350E-03 


10/2/97 

CHORS 

m 

6.160E-03 

6.261 E-03 

5.959E-03 

6.950E-03 

7.016E-03 


4.488E-03 

10/4/97 


m 

6.227E-03 

6.307E-03 

5.955E-03 

6.819E-03 

6.944E-03 

4.556E-03 

4.454E-03 

\mssm 



-1.08 

-0.72 

0.06 

1.89 

1.03 

0.01 

0.77 



— — - 

10/6/97 

UCSB 1 

A 


6.345E-03 

5.976E-03 

6.849E-03 

6.979E-03 

4.546E-03 

4.426E-03 

10/6/97 


m 

6.259E-03 


6.065E-03 


7.074 E-03 

4.621 E-03 

4.479E-03 

% Dif. 2 lamps 


-1.38 


-1.48 

-1.83 

-1.36 

-1.64 

-1.19 


!■ ■ II II ill 1 1^^^ KKIUraKl 


1 11/21/97 

GSFC2 

m 





BdMrJM 


—■1 



m 

1 

i 

s 



| 


BBnliK 


EHEH 



Hi 



■■RSI 

HHBH 

■■Pc! 











GSFC 3 








4.422E-Q3I 


sri 



Era=B5! 

IjSIEjSjcj 

ixnnssi 







BHBV33 

-0.45 

1 -CL39 

-SL21 

-0.61 

-0.41] 
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Table 21. Head OCR-200 S/N 047, Calibration Coefficients by Wavelength 



ED(411.0) ED(442.5) ED(489.9) ED(509.4) ED(554.6) ED(665.8) 

ED(682.8) 



Date 

Lab 

Test 






: 

8/11/97 

Satlantic 

m 

6.370E-03 

6.548E-03 

6.169E-03 

wmm 

WSS3& 

4.142E-03 

4.357E-02 

8/12/97 


B 

6.339E-03 

6.533E-03 

6.120E-03 


m 

WKESB& 

4.315E-02 

% D/7, 2 Lamps 


0.49 

0.22 

0.79 

WKMSKSi 

0.02 


0.9E 





8/29/97 

GSFC 1 


6.457E-03 


6.192E-03 

IHl 

pin 

BlllSf 






■'ll 111 11 1 






CHORS 

ESU 

6.439E-03 

6.570E-03 

6.165E-03 

ehehbe 

6.889E-03 

4.169E-0d 4.430E-02 


10/4/97 



6.541 E-03 

EHE35E 

6.138E-03 

6.685E-02 

6.792E-03 

nBiHimSEBSSl 

mmmmm 


-1 .58 

-0.69 

0.43 

1.9d 

1.42 

-0.02 1.12 







10/6/97 

UCSB 1 

AB 

6.496E-03 

6.671 E-03 

1 MMMA 

6.772E-02I 6.868E-03 

4.191 E-0d 4.384E-0d 


10/6/97 


BE 

6.524E-03 

6.700E-03 

6.258E-03 

6.836E-02I 6.932E-03 

4.229E-0d 4.441 E-02 

m 


■mu 

-0.44 

-0.74 

-0.93 -0.93 

-0.90 -1.31 





i4!:VJ4k’ 

^ | 


11/21/97 

GSFC 2 

m 






4.064E-02 




IS 





6.778E-03 


mwnrnfimm 



-1.97 

-1.66 

■HKRE 

-1.52 

-1.5^ -1.86 






(333*19 






KSJSTraRE 

-4.152E-Q2 

4.343E-Q2 

4-365E-02 



BIS! 


1 

a 

1 



6.795E-Q3 

1 


-0.48 

-Q.24 

-0 16 

-0 3F 


-0.26 

-0.51 





Table 22 and table 23 give the same information as the two Note (3) indicates one laboratory that used the central 

tables above, but give it as a percentage of the difference wavelength for each of the filters instead of the 20 Degree 

from the mean for all laboratories. This percentage was Cone Wavelengths. These data, with and without this 

calculated by subtracting the value from the mean and correction, were analyzed in section 4.4.1. 

dividing by the mean. 
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Table 22. Head OCR-200 S/N 049, Percent Difference From the Mean by Laboratory and Wavelength 


ED(411.0) ED(442.8) ED(490.4) ED(509.3) ED(554.6) ED(665.5) ED(682.7) 


Mean 


6.093E-03I 6.244E-03I 5.908E-03I 6.795E-03| 6.893E-03| 4.524E-03I 4.403E-03 


Satlan 

% 

-0.58 

-0.42 

-0.14 

-0.33 

-0.37 

0.00 

-0.59 


% 

0.75 

0.91 

1.35 

1.28 

1.41 

1.15 

1.76 

PML 

% 

0.55 

-0.73 

-1.65 

-1 .40 

-1.16 

-1.02 

-0.70 


% 

1.21 

1.52 

0.29 

0.18 

-1.57 

0.33 

-1.20 

CHORS 

% 

1.11 

0.28 

0.87 

2.29 

1.78 

0.71 

1.94 

Biosphere 

% 

-1.80 

-1.51 

-0.88 

-1.14 

-0.72 

-0.70 

-0.21 

UCSB (3) 

% 

2.03 

2.28 

1.91 

1.72 

1.93 

1.31 

1.12 

NRL 

% 

-2.51 

-1.88 

-1.58 

-1.64 

-1.70 

-1.69 

-1.93 

GSFC2 

% 

-1.99 

-1.89 

-1.45 

-1.29 

-1.08 

-1.30 

-1.55 


% 

-0.20 

0.22 

0.07 

-0.05 

0.13 

0.26 



(3) Central Wavelengths Used 


Table 23. Head OCR-200 S/N 047, Percent Difference From the Mean by Laboratory and Wavelength 

ED(411.0) ED(442.5) ED(489.9) ED(509.4) ED(554.6) ED(665.8) ED(682.8) 


Mean I 6.404E-03I 6.558E-03I 6.130E-03I 6.687E-03I 6.776E-03I 4.144E-03 4.355E-03| 


Satlantic 

% 

-0.76 

-0.26 

0.23 

-0.66 

-0.53 

0.3 

oy 

GSFC 1 

% 

0.84 

0.53 

1.01 

1.09 

0.7C 

-0.6 

-1.6 

PML 

%" 

-0.11 

-1.27 

-1.53 

-1.59 

-1.39 


0.E 

JRC-SAI 

% 

0.90 

1.55 

0.60 

0.03 

-1.35 

-0.5 

0.9 

CHORS 

% 

0.56 

0.20 

IHKE& 

1.91 

1.66 

-0.6 

-1.1 

Biosphere 

% 

-0.39 

-0.80 

-0.81 

-0.23 

-0.671 

1.5 

0.7 

UCSB (3) 

% 

1.67 

1.95 

1.70 

1.75 

1.83 

-1.6 

-1.3 

NRL 

% 

-1.86 

-1.14 

-0.94 

-0.6E 

-0.88 

1.1 

1.5 


% 

-1.75 

-1.72 

-1 .38 

-1 .1C 

-0.72 

1.2 

1.6 


% 

-0.19 

0.06 

-0.06 

-0.25 

0.25 




(3) Central Wavelengths Used 
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4.3 Laboratories Using Different Standards 

During SIRREX-6, two laboratories were tested that did not 
use the same lamp types or reference laboratories as was 
used for the bulk of the SIRREX-6 tests. These tests are 
considered separately here and were not included in the 
calculation of the means. 

4.3.1 DLR in Germany 

The SIRREX-6 test was run at the Institut flir 
Weltraumsensorik (DLR) in Berlin. This laboratory sup- 
ports the Modular Opto-electronic Scanner (MOS) space 
instrument. It uses a 1000-W standard lamp from “Giga- 
hertz-Optik,” (FischerstraUe 4, D-82178 Puchheim/ 
Miinchen) and calibrated from the “Deutscher 


Kalibrierdienst DKD, calibration laboratory for optical 
radiometry” (a part of Gigahertz-Optik) in November 1996. 
The radiometric values are traceable to the national radio- 
metric standards of the Physikalisch-Technische 
Bundesanstalt PTB. 

Their plaque was built in-house, has a barium sulfate 
surface, and is a disk 308 mm in diameter. The plaque is 
calibrated in place at their normal angle of 35 degrees using 
a dedicated bench spectrometer with a small field of view. 
The plaque is X-Y scanned with 56 readings. 

Table 24 shows the percent difference from the mean 
separately for the radiance and irradiance heads. These 
results are in quite reasonable agreement with the 
SIRREX-6 mean. 


Table 24. Percentage Difference From Mean Using European Stand Lamp 


Radiance 

411.x nm 

443.x nm 

489.x nm 

509.7 nm 

554.1 nm 

665.x nm 

682.x nm 


% Diff 

1.90 

1.00 

0.56 

-0.54 

-0.19 

0.65 

2.02 

% 

Max 

2.29 

1.37 

1.48 

-0.52 

0.26 

0.68 

2.23 

% 

Min 

1.51 

0.63 

-0.37 

-0.56 

-0.65 

0.62 

1.81 

% 

Irradiance 









% Diff 

3.32 

2.54 

1.35 

1.59 

1.49 

2.10 

2.68 

% 

Max 

3.40 

2.56 

1.67 

1.61 

1.51 

2.18 

2.83 

% 

Min 

3.24 

2.52 

1.04 

1.56 

1.48 

2.02 

2.52 

% 

Mean of all tests 


1.46 





% 

Maximum of all tests 


3.32 





% 

Minimum of all tests 


-0.54 





% 
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4.3.2 Wallops Flight Facility 

NASA’s Wallops Flight Facility (WFF) flies a variety of 
ocean color instruments in aircraft. They are mounted to 
look down through a window in the bottom of the aircraft. 
WFF investigators maintain a small calibration laboratory to 
support this effort. 

Due to limited laboratory space, WFF uses a 200-watt 
reference lamp instead of the 1000 watt lamps used in the 
SIRREX-6 tests. This lamp was set 500 mm from the 
diffuser as compared to the 1300 mm typically used with 
the more powerful lamp. This shorter distance increases 
geometric effects in the test. Table 25 shows reasonable 
agreement with the SIRREX-6 mean. 


Wallops also has used a 30-inch diameter integration 
sphere that can rotate with its window directly up so that it 
may be run directly under the aircraft. At the time of the 
SIRREX test this sphere was thought to be out of calibra- 
tion and was not used for field instrument calibration. This 
sphere was tested by being turned horizontally with its 
stops set a level 5 for the minimum light. This test did not 
produce good agreement with SIRREX-6, as shown in 
table 26. The reason for this discrepancy is thought to be a 
yellowing of the internal coating of the sphere. This sphere 
will be recalibrated before further use. 


Table 25. Percent Difference From Mean for 200 Watt Lamp at WFF 


Radiance 

411.x nm 

443.x nm 

489.x nm 

509.7 nm 

554.1 nm 

665.x nm 

682.x nm 


% Diff 

1.42 

1.86 

0.79 

0.54 

0.94 

0.61 

2.98 

% 

Max 

1.64 

2.05 

1.44 

0.99 

1.00 

0.64 

3.25 

% 

Min 

1 .19 

1.67 

0.13 

0.09 

0.87 

0.57 

2.71 

% 

irradiance 









% Diff 

-1.78 

-2.83 

-3.70 

-2.03 

-0.73 

-1.43 

-1.36 

% 

Max 

-1.36 

-2.52 

-3.64 

-1.71 

-0.27 

-0.99 

-1.32 

% 

Min 

-2.19 

-3.15 

-3.76 

-2.34 

-1.20 

-1.87 

-1.41 

% 

Mean of ail 

tests 


-0.34 





% 

Maximum of all tests 


2.98 





% 

Minimum of all tests 


-3.70 





% 


Table 26. Percent Difference From Mean for Integration Sphere at WFF 


Radiance 

411.x nm 

443.x nm 

489.x nm 

509.7 nm 

554.1 nm 

665.x nm 

682.x nm 

% Diff 

62.76 

43.83 

26.79 

25.54 

17.56 

144.73 

183.77 

Max 

63.03 

44.06 

27.05 

25.68 

17.57 

147.51 

189.72 

Min 

62.49 

43.61 

26.53 

25.39 

17.56 

141.94 

177.82 

Mean of all 

tests 


72.14 


Maximum of all tests 183.77 % 

Minimum of all tests 1 7.56 % 
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4.4 Special Tests 

The SIRREX-6 allows the examination of the impact of 
variations in calibration procedures. 

4.4.1 Satlantic Calibration 

Satlantic is the manufacturer of the underwater photometer 
heads used in SIRREX-6. During their first tests, Satlantic 
independently ran their standard calibration procedure for 
these units. Table 27 shows the relationship between the 
calibration numbers provided by Satlantic and the mean of 
all the tests under SIRREX-6. The agreement is quite good. 

4.4.2 20 Degree Cone Correction 

The light filters used on the heads are manufactured by 
laying down thin alternating layers of metal and transparent 
material. These layers were very precisely controlled to set 
the bandpass wavelength. Light passing through the filter at 
an angle sees the layers as farther apart than light passing 
directly through, so the effective bandpass wavelength 
changes slightly. 


The filter manufacturer’s bench spectrograph used to measure 
the filters has a field of view of only 3 degrees. The radiance 
heads used for SIRREX-6 have a field of view of 20 degrees 
and the irradiance heads have an even wider cosine- weighted 
field of view. This means that the effective bandpass wave- 
length for these heads was slightly bluer (shifted to shorter 
wavelength) than the original filter test would indicate. The 
manufacturer provides a calculated correction for this effect 
called the “20 Degree Cone.” 

Most of the laboratories in SIRREX-6 used the 20 Degree 
Cone bandpass wavelengths but UCSB did not. This created 
the opportunity for demonstrating the level of this effect on 
the data. Table 28 shows the percentage difference between 
the data calculated with and without the 20 Degree Cone 
correction. The coefficients with the corrections were 
subtracted from those without and divided by those without. 

The mean effect is a reduction of 1% across all wavelengths 
for both the radiance and irradiance heads. The effect is 
stronger in the shorter wavelengths and for the irradiance 
heads. 


Table 27. Percent Difference Between Satlantic Calibration and Mean 


411.x nm 443.x nm 489.x nm 509.7 nm 554.1 nm 665.x nm 682.x nm 


Radiance -1 .08 

-1.17 

-1.01 

-1.83 -1.71 -0.46 -0.64 

% 

Irradiance -0.68 

-0.66 

-0.29 

-0.61 -0.63 -0.09 -0.59 

% 

Mean of all tests 


-0.82 


% 

Maximum of all tests 


-0.09 


% 

Minimum of all tests 


-1.83 


% 


Table 28. Effect of 20 Degree Cone in Percent Deviation From Mean 
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4.4.3 On Axis Measurements 

At some laboratories each head was measured seven times, 
once with each filter on the optical axis. This was done by 
offsetting the head and rotating it to bring the six outside 
filters on-axis. 

This procedure produced a significant change in the 
readings only if; 

1 . The input aperture of the integration sphere was 
small. 

2. The uniformly illuminated area of a plaque was 
smaller than the field of view of the offset channels. 

4.4.4 SXR 

The SeaWiFS Transfer Radiometer (SXR) is a laboratory 
reference instrument developed by NIST and used with the 
GSFC 42-inch integration sphere in preflight testing of the 
SeaWiFS instrument in the spring of 1997. SIRREX-6 
provided an opportunity to compare SXR readings of the 
same GSFC integration sphere with the standards used for 
SeaWiFS preflight measurements. 

The readings from the SXR were used to shift a model 
curve of the sphere wavelength response. Then the shifted 
curve was used to obtain the radiance value at the Satlantic 
Head wavelengths. Only four of the wavelengths were close 
enough for this approach. 


The wavelengths of the SXR and the Satlantic Heads do not 
exactly match, and neither match the calibration points on 
the model curve. The same four-point interpolation method 
recommended by NIST for FEL lamps and plaques was 
used. Other methods are possible and the result is sensitive 
to the interpolation method used. 

Table 29 shows that the results for the SXR reading the 
sphere are about 1 % less than the level calculated with the 
mean of the Satlantic radiance head data. The published 
values for the SXR calibration and the mean calibration 
constants from the nine SIRREX-6 tests were used. 

Also available in the same test period was the VXR, which 
is a second version of the SXR design with only a few 
mechanical changes. Table 30 shows a comparison of the 
VXR data taken at the same time as the SXR data and 
reduced in the same manner. 

This data and analysis shows that the results for the VXR 
reading the sphere are about 1% greater than the level 
calculated with the mean of the Satlantic radiance head data. 
The mean calibration constants from the nine SIRREX-6 
tests were used. 


Table 29. Percent Difference Between SXR and Radiance Heads 


SXR Adj 

38, 39 Mean 

% Diff 


411.x nm 

443.x nm 

489.x nm 

509.x nm 

554.x nm 

665.x nm 

682.x nm 

1 .704 

1.453 

2.647 


1.173 

2.013 

2.171 

1.726 

1.478 

2.658 

0.822 

1.188 

42.795 

1.134 

-1.28 

-1.74 

-0.42 


-1.34 

- 2025 . 85 \ 

47.74 


N/A Out of range 


Mean % STD 

-1.19 0.85 


N/A -- Wavelength not available 


VXR 

38, 39 


Adj 
Mean 
% Diff 


Table 30. Percent Difference Between VXR and Radiance Heads 


411.x nm 443.x nm 489.x nm 509.x nm 554.x nm 665.x nm 682.x nm 


1.772 

1.505 



1.177 

2.016 

2.136 

1.726 

1.478 

2.658 

0.822 

1.188 

42.795 

1.134 

2.62 

1.81 



-0.92] 

- 2022.67 

46.90 


N/A N/A Out of range 


Mean % STD 

1.17 1 .82 N/A - Wavelength not available 
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4A5 Multiple Tests at GSFC 

The initial SIRREX-6 plan called for tests at Goddard Space 
Flight Center (GSFC) early and late in the series. To resolve 
questions that arose after the second test, the irradiance 
portion of the test was rerun a few weeks later for a third 
time. The integrations sphere was not available to repeat the 
radiance tests. 

Table 31 shows the difference between the first and last test 
as a fraction of the mean from all tests. The radiance data is 
about 0.58% higher for the second test. The irradiance data 
is about 1.2% lower for the third test. 

The second and third irradiance tests were reviewed in 
detail and a difference was found in the current driving the 


lamps. In the first and last tests a preprogrammed level in 
the power supply was used, resulting in a lamp current of 
7.999 amps as read on the current shunt. In the second test 
the power supply was set manually to the same value on the 
indicator but the current shunt reading was 7.996 amps. The 
light output of the lamp is proportional to the fourth power 
of the current. The difference in the second and third data 
set is what is expected from this change in current. The 
third GSFC irradiance test was the most precise repeat of 
the first GSFC test. 

This retest shows how sensitive this testing is to the 
procedures used. 


Table 31. Percent Difference GSFC 2/GSFC 1 and GSFC 3 /GSFC 1 


Radiance 

411.x nm 443.x nm 489.x nm 509.x nm 554.x nm 665.x nm 682.x nm 


GSFC2/1 

-1.35 

0.50| 1.23 

1.22| 1.321 O/R 

O/R 1 7.999 amp 

Irradiance 









GSFC2/1 

-3.62 

-3.43 

-3.34 

-3.16 

-2.66 

2.89 

3.99 

7.996 amp 


GSFC3/1 

-1.13 

-0.80 

-1.32 

-1.52 

-0.93 

-0.93 

-1.60 

7.999 amp 



Mean 

Max 

Min 







Rad 

0.58 

1.32 

-1.35 






Irr 

-1.18 

-0.80 

-1.60 






Both 

•0.44 

1.32 

-1.60 
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5. SIRREX-6 RECOMMENDATIONS 

The authors would like to make the following recommenda- 
tions to improve SeaWiFS ground truth procedures and 
future SIRREX efforts. 

5.1 Future SIRREX 

Future SIRREX tests would benefit from the following: 

1. A standard 500-mm rod — SIRREX personnel will carry 
their own 500 mm rod to set the lamp head distance for 
irradiance tests. This is the most critical distance in these 
tests. Errors of only a few millimeters will result in the 
instrument calibration being off by several percent. A fixed 
rod is the best way for a repeatable setting of this distance. 

Some laboratories have baffle arrangements that make the 
use of this rod or any other measuring method difficult. 

Such arrangements should be modified. 

2. A traveling lamp — NASA will transfer the calibration 
from its Optronic laboratories FEL-M Standard of Spectral 
Irradiance Lamp (S/N F-474) to four Hoffman FEL lamps. 
One of these lamps will then be carried throughout SIRREX 
as a traveling standard. This will help distinguish between 
data changes caused by changes in the test instruments and 
data changes caused by laboratory procedure variations. 

5.2 NASA-Provided Equipment 

NASA can facilitate the consistency of the ground truth 
tests by providing each laboratory with the following: 

1. 500-mm rod 

2. Standard black lollipops 

5.3 Consistency of Test Procedures 

The SIRREX-6 effort can serve as the basis for discussions 
of uniform test procedures on the following points: 

1 . 20 degree cone correction 

2. Ambient tests with lollipop 

3. Interpolation method of lamp reference data 

4. Non-Lambertian correction for plaques 


6. CONCLUSIONS 

Laboratories tested were uniform to better than ± 2% on 
average. This is an encouraging result. 

Improvements in this agreement can be achieved by 
working low-level details of the equipment and the data 
reduction practices of the individual laboratories. 

Future SIRREX tests of some sort will be needed to monitor 
and improve these results. 
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calibration of these types of instruments by the various laboratories were also used for this experiment. 
NASA personnel processed the data to produce calibration parameters from the various laboratories 
for comparison. 

These tests showed an overall agreement at better than the ± 2% level. Analysis of each laboratory’s 
efforts and specific data handling procedures are included. 
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